Mutual Information, Fisher Information and Population Coding
نویسندگان
چکیده
In the context of parameter estimation and model selection, it is only quite recently that a direct link between the Fisher information and information-theoretic quantities has been exhibited. We give an interpretation of this link within the standard framework of information theory. We show that in the context of population coding, the mutual information between the activity of a large array of neurons and a stimulus to which the neurons are tuned is naturally related to the Fisher information. In the light of this result, we consider the optimization of the tuning curves parameters in the case of neurons responding to a stimulus represented by an angular variable.
منابع مشابه
Mutual Information, Fisher Information and Population Coding Submitted to Neural Computation
In the context of parameter estimation and model selection, it is only quite recently that a direct link between the Fisher information and information theoretic quantities has been exhibited. We give an interpretation of this link within the standard framework of information theory. We show that in the context of population coding, the mutual information between the activity of a large array o...
متن کاملAccuracy Measures for Neural Population Codes with Correlated Variability
Information theoretic measures such as the mutual information, and the recently proposed stimulus-specific information, provide a powerful tool for the study of the neural code. In practice, however, it is difficult to calculate these measures from experimental results due to the amount of data required. Fisher information, and derived quantities such as IFisher , are a popular alternative as t...
متن کاملVariational Information Maximization for Neural Coding
Mutual Information (MI) is a long studied measure of coding efficiency, and many attempts to apply it to population coding have been made. However, this is a computationally intractable task, and most previous studies redefine the criterion in forms of approximations. Recently we described properties of a simple lower bound on MI [2]. Here we describe the bound optimization procedure for learni...
متن کاملDifficulty of Singularity in Population Coding
Fisher information has been used to analyze the accuracy of neural population coding. This works well when the Fisher information does not degenerate, but when two stimuli are presented to a population of neurons, a singular structure emerges by their mutual interactions. In this case, the Fisher information matrix degenerates, and the regularity condition ensuring the Cramér-Rao paradigm of st...
متن کاملFisher and Shannon Information in Finite Neural Populations
The precision of the neural code is commonly investigated using two families of statistical measures: Shannon mutual information and derived quantities when investigating very small populations of neurons and Fisher information when studying large populations. These statistical tools are no longer the preserve of theorists and are being applied by experimental research groups in the analysis of...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Neural computation
دوره 10 7 شماره
صفحات -
تاریخ انتشار 1998